A hybrid network and topic analysis of the competence research area in educational contexts

Details

  • Author. Felipe Urrutia Vargas
  • Contributions.
    • Methodology,
    • Software,
    • Validation,
    • Investigation,
    • Data curation,
    • Visualization
  • Date. 16/07/2022
  • Article. doi/...

Content

Methodology

Direct citation graph analysis

https://app.vosviewer.com/?json=https://drive.google.com/uc?id=1zvpZVz6r3-kkoSw8BUzPg8aOfU0Iasz4

Load data

Load libraries

In [1]:
from util import *

Load scopus data

In [4]:
df_scopus = read_bibliography(
    file_path="scopus.csv"
)
In [5]:
df_scopus.info()

<class 'pandas.core.frame.DataFrame'>
RangeIndex: 908 entries, 0 to 907
Data columns (total 24 columns):
 #   Column             Non-Null Count  Dtype  
---  ------             --------------  -----  
 0   id                 908 non-null    int64  
 1   Authors            908 non-null    object 
 2   Author(s) ID       907 non-null    object 
 3   Title              908 non-null    object 
 4   Year               908 non-null    int64  
 5   Source title       908 non-null    object 
 6   Volume             871 non-null    object 
 7   Issue              802 non-null    object 
 8   Art. No.           144 non-null    object 
 9   Page start         756 non-null    object 
 10  Page end           756 non-null    object 
 11  Page count         1 non-null      float64
 12  Cited by           724 non-null    float64
 13  DOI                803 non-null    object 
 14  Link               908 non-null    object 
 15  Abstract           908 non-null    object 
 16  Author Keywords    783 non-null    object 
 17  Index Keywords     221 non-null    object 
 18  References         901 non-null    object 
 19  Document Type      908 non-null    object 
 20  Publication Stage  908 non-null    object 
 21  Open Access        379 non-null    object 
 22  Source             908 non-null    object 
 23  EID                908 non-null    object 
dtypes: float64(2), int64(2), object(20)
memory usage: 170.4+ KB

Load (all-) direct citation network from json file generated by VOSviewer

Parameters of VOSviewer

  • Method normalization: No normalization
  • Layout:
    • Attraction: 1
    • Repulsion: 0
  • Clustering:
    • Resolution: 0.001
    • Min. cluster size: 187
  • Merge small clusters: Disable
In [2]:
all_network_items = read_network(
    file_path='complete_citation_net.json'
)

obs: (Red) Dense component, (Gray) Others

Load (sub-) direct citation network from json file generated by VOSviewer

Parameters of VOSviewer

  • Method normalization: Association strenght
  • Layout:
    • Attraction: 10
    • Repulsion: 1
  • Clustering:
    • Resolution: 0.05
    • Min. cluster size: 5
In [3]:
network_items = read_network(
    file_path='direct_citation_net.json'
)

Merge both files

In [6]:
df_docs = get_docs(
    network_items, 
    df_scopus
)

Exploratory data analysis

(all-) Direct citation network

Frecuencies

In [7]:
get_group_table(all_network_items)
Out[7]:
#Docs
Group
Others 721
Dense component 187

Links

In [8]:
get_links_stats_table(all_network_items)
Out[8]:
Links
sum mean std min 25% 50% 75% max
Docs
All 862.0 0.949339 3.086705 0.0 0.0 0.0 1.0 53.0
Others 72.0 0.099861 0.359030 0.0 0.0 0.0 0.0 3.0
Dense component 790.0 4.224599 5.690289 1.0 1.0 2.0 4.5 53.0

(sub-) Direct citation network

Plot frecuencies of clusters

In [9]:
plot_frec_clusters(df_docs)

Most cited papers per cluster

In [10]:
get_top_cited_table(df_docs, network_items, min_citations=31)
Out[10]:
Cluster Year Authors Title Citations
182 1 1997 Tabbron G., Yang J. The interaction between technical and vocational education and training (TVET) and economic development in advanced countries 55
173 1 2006 Stolk J., Martello R. Pedagogical fusion: Integration, student direction, and project-based learning in a materials science-history of technology course block 151
171 1 2007 Mulder M., Weigel T., Collins K. The concept of competence in the development of vocational education and training in selected EU member states: A critical analysis 43
169 1 2007 Rademakers J.J.D.J.M., De Rooy N., Ten Cate O.Th.J. Senior medical students' appraisal of CanMEDS competencies 534
166 1 2008 Hoskins B. The discourse of social justice within European education policy developments: The example of key competences and indicator development towards assuring the continuation of democracy 42
162 1 2009 Winters A., Meijers F., Kuijpers M., Baert H. What are vocational training conversations about? Analysis of vocational training conversations in dutch vocational education from a career learning perspective 73
160 1 2009 Linkaityte G.M., Lapeniene A., Jakubauskaite V. Project work stimulates changes in pedagogical practice [Projektine veikla skatinami pedagoginiai pokyčiai] 95
156 1 2010 Phillips T., Goehing C., Shaw I., Oram J. Personalisation, support brokerage and social work-what are we teaching social work students? 312
150 1 2011 Berdrow I., Evers F.T. Bases of competence: A framework for facilitating reflective learner-centered educational environments 1007
143 1 2011 Evers F.T. Bases of competence: A framework for facilitating reflective learner-centered educational environments 61
142 1 2012 Martínez-Mediano C., Lord S.M. Lifelong Learning competencies program for engineers 359
141 1 2012 Thanopoulos C., Protonotarios V., Stoitsis G. Online web portal of competence-based training opportunities for organic agriculture 108
121 1 2013 van Dinther M., Dochy F., Segers M., Braeken J. The construct validity and predictive validity of a self-efficacy measure for student teachers in competence-based education 75
101 1 2015 Katz N.H., Sosa A. The Emotional Advantage: The Added Value of the Emotionally Intelligent Negotiator 58
85 1 2017 Sieglová D., Stejskalová L., Kocurová-Giurgiu I. Optimizing language instruction at the tertiary level: Student needs analysis toward educational change 49
82 1 2018 Ritzhaupt A.D., Martin F., Pastore R., Kang Y. Development and validation of the educational technologist competencies survey (ETCS): knowledge, skills, and abilities 33
77 1 2018 Pitura J., Terlecka-Pacut E. Action research on the application of technology assisted urban gaming in language education in a Polish upper-secondary school 35
70 1 2019 Halimi S.A. Rethinking the English–Arabic Legal Translation Course: Restructuring for Specific Competence Acquisition 35
69 1 2019 Quiroz-Ninõ C., Blanco-Encomienda F.J. Participation in decision-making processes of community development agents: A study from Peru 31
66 1 2019 López-Alcarria A., Olivares-Vicente A., Poza-Vilches F. A systematic review of the use of Agile methodologies in education to foster sustainability competencies 56
40 1 2021 Bhalerao A.K., Rasche L., Schneider U.A. Preparing for a better future: Delphi forecasts on competency development to enhance climate-resilient farming in Northeastern India 63
179 2 1998 Hattam R., Smyth J. Competing logics in the key competencies: A sociological reading of post-compulsory education and training in australia 35
174 2 2004 Evans K., Kersh N. Recognition of tacit skills and knowledge: Sustaining learning outcomes in workplace environments 49
175 2 2004 Van Horen B., Leaf M., Pinnawala S. Localizing a global discipline: Designing new planning programs in Sri Lanka 169
172 2 2007 Albir A.H. Competence-based curriculum design for training translators 87
165 2 2009 Aneas A., Montané A. Let's go work together: Introducing intercultural competencies at the universitat de Barcelona 75
154 2 2010 Struyven K., De Meyst M. Competence-based teacher education: Illusion or reality? An assessment of the implementation status in Flanders from teachers' and students' points of view 37
155 2 2010 Sahin M., Akbasli S., Yelken T.Y. Key competences for lifelong learning: The case of prospective teachers 58
159 2 2010 Falloon G. Using avatars and virtual environments in learning: What do they have to offer? 49
151 2 2011 Levinsen K.T. Fluidity in the networked society - Self-initiated learning as a digital literacy competence 98
139 2 2012 Chrzanowska I. The chances of people with disabilities for continuing education and opportunities of employment in the context of the key competences level of vocational school-leavers 31
140 2 2012 Azevedo A., Apfelthaler G., Hurst D. Competency development in business graduates: An industry-driven approach for examining the alignment of undergraduate business education with industry requirements 59
102 2 2015 Koenen A.-K., Dochy F., Berghmans I. A phenomenographic analysis of the implementation of competence-based education in higher education 34
103 2 2015 Hernandez-Linares R., Agudo J.E., Rico M., Sánchez H. Transversal competences of university students of engineering [Transverzalne kompetencije studenata strojarstva] 48
168 3 2007 Barth M., Godemann J., Rieckmann M., Stoltenberg U. Developing key competencies for sustainable development in higher education 46
158 3 2010 De Pro Bueno A., Rodríguez Moreno J. Learn key competences in a proposal for the teaching of electrical circuits in primary education [Aprender competencias en una propuesta para la enseñanza de los circuitos eléctricos en Educación ... 54
146 3 2011 Pepper D. Assessing key competences across the curriculum - and Europe 34
147 3 2011 Halász G., Michel A. Key competences in Europe: Interpretation, policy formulation and implementation 64
148 3 2011 Hehir A. Hyper-reality and statebuilding: Baudrillard and the unwillingness of international administrations to cede control 121
114 3 2014 Naumann F., Moore K., Mildon S., Jones P. Developing an objective structured clinical examination to assess work-integrated learning in exercise physiology 50

(all-) Direct citation network

Histogram of number of docs per year

In [11]:
plot_docs_per_year(df_scopus)

Histogram of number of docs per source (Top 25)

In [12]:
plot_docs_per_source(df_scopus)

Latent semantic analysis (LSA) per cluster

Preprocess data

Add preprocessing of data

  • Remove stopwords
  • Uncased tokens
  • Lemmatize tokens
  • Tokenize uni- and bi-grams
In [13]:
%%time
add_preprocess(df_docs)

Wall time: 10.3 s

LSA per cluster

Number of topics per cluster

Criteria: Elbow of eigenvalues

  • Cluster 1: 8
  • Cluster 2: 5
  • Cluster 3: 4
In [14]:
num_topics_per_cluster = {
    1: 8, 
    2: 5, 
    3: 6
}

Cluster 1

In [15]:
LSA_1 = LSA(
    df_docs, 
    cluster_id=1, 
    num_topics=num_topics_per_cluster[1]
)
In [16]:
plot_top_eigenvalues(LSA_1, cluster_id=1, k=25)
In [17]:
topics_1 = get_topics(LSA_1)

Plor frecuencies of topics

In [18]:
table_hist_per_topic_1 = get_table_hist_per_topic(topics_1["index_per_factor"])
In [19]:
plot_topics(table_hist_per_topic_1, cluster_id=1, by="Docs")
In [20]:
plot_topics(table_hist_per_topic_1, cluster_id=1, by="Terms")

Plot strength words per topic

In [21]:
strengths_1 = get_strengths(LSA_1, topics_1["term_per_factor"])
In [22]:
plot_strength_per_topic(strengths_1, cluster_id=1)
In [23]:
get_terms_table(
    table_hist_per_topic_1, 
    strengths_1
)
Out[23]:
Top 10 terms #Terms #Docs
Topic
0 sustainability, sustainable, sustainable development, teacher, competency, high education, student, program, learning, skill 824 11
1 sustainability, learner center, center, reflective, learner, translation, critical thinking, sustainable, sustainable development, critical 612 12
2 learner center, center, reflective, learner, critical thinking, translation, critical, sustainability, thinking, educational environment 386 9
3 critical thinking, translation, vocational, thinking, translator, critical, sustainability, collaborative, vocational education, collaborative learning 998 11
4 decision making, making, decision, clinical, sustainability, vocational, medical, dental, vocational education, extracurricular 1081 8
5 skill, game, collaborative, vocational, soft skill, soft, century skill, universal, century, inclusive 785 10
6 vocational, medical, decision, decision making, making, primary school, clinical, entrepreneurial, vocational education, mathematic 1024 11
7 medical, sustainable, sustainability, entrepreneurship, collaborative, sustainable development, mindfulness, entrepreneurial, translation, inclusive 997 14

Cluster 2

In [24]:
LSA_2 = LSA(
    df_docs, 
    cluster_id=2, 
    num_topics=num_topics_per_cluster[2]
)
In [25]:
plot_top_eigenvalues(LSA_2, cluster_id=2, k=25)

Plor frecuencies of topics

In [26]:
topics_2 = get_topics(LSA_2)
In [27]:
table_hist_per_topic_2 = get_table_hist_per_topic(topics_2["index_per_factor"])
In [28]:
plot_topics(table_hist_per_topic_2, cluster_id=2, by="Docs")
In [29]:
plot_topics(table_hist_per_topic_2, cluster_id=2, by="Terms")

Plot strength words per topic

In [30]:
strengths_2 = get_strengths(LSA_2, topics_2["term_per_factor"])
In [31]:
plot_strength_per_topic(strengths_2, cluster_id=2)
In [32]:
get_terms_table(
    table_hist_per_topic_2, 
    strengths_2
)
Out[32]:
Top 10 terms #Terms #Docs
Topic
0 teacher, medical, competence, competence base, digital, competency, student, curriculum, training, teaching 600 10
1 medical, climate change, health, medical education, climate, teacher, undergraduate, education medical, resident, sweden 747 6
2 digital, cbe, competence base, medical, digital competence, skill, teacher, virtual, base education, implementation 639 10
3 teacher, diagnostic, translation, diagnostic competence, learn behavior, portfolio, translator, assessment, module, behavior 709 11
4 scientific, science, science curriculum, digital, socio, sst, socio scientific, scientific knowledge, topic, delphi 770 7

Cluster 3

In [33]:
LSA_3 = LSA(
    df_docs, 
    cluster_id=3, 
    num_topics=num_topics_per_cluster[3]
)
In [34]:
plot_top_eigenvalues(LSA_3, cluster_id=3, k=25)

Plot frecuencies of topics

In [35]:
topics_3 = get_topics(LSA_3)
In [36]:
table_hist_per_topic_3 = get_table_hist_per_topic(topics_3["index_per_factor"])
In [37]:
plot_topics(table_hist_per_topic_3, cluster_id=3, by="Docs")
In [38]:
plot_topics(table_hist_per_topic_3, cluster_id=3, by="Terms")

Plot strength words per topic

In [39]:
strengths_3 = get_strengths(LSA_3, topics_3["term_per_factor"])
In [40]:
plot_strength_per_topic(strengths_3, cluster_id=3)
In [41]:
get_terms_table(
    table_hist_per_topic_3, 
    strengths_3
)
Out[41]:
Top 10 terms #Terms #Docs
Topic
0 curriculum, digital, digital competence, policy, competence base, sustainability, engineering, student, school, competence 490 7
1 states, member states, policy, member, curriculum, engineering, digital, european, sustainability, digital competence 543 6
2 curriculum, competence base, secondary school, policy, base curriculum, secondary, states, member states, modular, modular competence 618 5
3 digital, digital competence, sustainability, project base, vocational, field, base education, instrument, education student, student digital 302 7
4 sustainability, engineering, project base, industrial, awareness base, inner, digital competence, program, digital, professional 563 7
5 ict, ict literacy, literacy, student ict, primary, primary school, school student, engineering, teacher, technology 449 4